Reddit entity linking dataset

We introduce and make publicly available an entity linking dataset from Reddit that contains 17,316 linked entities, each annotated by three human annotators then grouped into Gold, Silver, Bronze to indicate inter-annotator agreement. analyze the different errors disagreements made suggest types of corrections raw data. Finally, we tested existing models are trained tuned on text non-social media datasets. find that, although these perform very well their original datasets, they poorly this social dataset. also show majority can be attributed poor performance mention detection subtask. These results need for better applied enormous amount text.